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ABSTRACT 


Current search algorithms and heuristics perform very poorly in the highly realistic 
scenario of a physical agent traversing an initially unknown search space. They do not 
attempt to minimize the amount of movement required by the physical agent attempting to 
reach a desired goal location. In order to overcome the failings of these algorithms in 
dealing with searches of this particular nature, a new algorithm called persistent search was 
created. 

Persistent search differs from most other algorithms because it focuses on 
minimizing the physical movement of an active agent traversing an unknown Search space, 
coping with the physical aspects of the problem which are too often ignored. Persistent 
search uses several standard search techniques but applies them in such a way as to change 
the semantics of the search. An interesting additional property of this algorithm is that 
through the manipulation of a single control variable, termed the persistence factor, the 
Operation of the basic algorithm can be changed to span the continuum of behaviors 


between depth-first and breadth-first search. 
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I. INTRODUCTION 


Current search algorithms and heuristics perform very poorly in the highly realistic 
scenario of a physical agent traversing an initially unknown search space. They do not 
attempt to minimize the amount of movement required by the physical agent to reach a 
desired goal location. Most algorithms ignore the physical aspects of search, measuring the 
quality of their solutions only by the amount of computation required. In order to 
overcome the failings of these search algorithms in dealing with searches of this particular 
nature, a new algorithm called persistent search was created and is presented here. 

Persistent search differs from most other algorithms because it focuses on minimizing 
the physical movement of an active agent traversing an unknown search space rather than 
on the number of comparisons. To deal with this twist on a classic search problem, 
persistent search copes with the physical aspects of the problem which are too often 
ignored. 

The difference between persistent search and other standard search algonthms likens 
to the difference between internal and external sorting algorithms. External sorting 
algorithms use the same methods as internal sorting algorithms but apply these methods 
differently. External sorting algorithms take into account the fact that they must interact 
with a mechanical device which 1s inherently very slow in comparison to strictly electronic 
operations. 

Persistent search uses several standard search techniques but applies them in such a 
way as to change the dynamics of the search. Persistent search provides the agent with the 
flexibility to handle the physical constraints of the problem. In a search over unknown 


terrain, where the relative location of the goal is known but the feasible paths to the goal are 


unknown, the search involves not only movement to the goal but also exploration. 
Exploration is the process of learning about one’s surrounding environment. 

Since the agent does not start with a map, it can only learn about its environment by 
moving through it. If a map were available to the agent, standard path planning algonthms 
could do relatively inexpensive computation to find the optimum path (shortest, least cost, 
most efficient, etc.) to the goal before the first step was ever taken by the agent. Without a 
map, the agent must instead physically roam its environment to learn about it by sensing the 
immediate surroundings. While exploration is movement which adds to the agent’s 
knowledge of its environment, a different kind of physical movement, backtracking, does 
not provide this offsetting benefit. 

Backtracking in the physical sense, unlike backtracking in classic search methods, 
entails the physical movement of the agent through its environment. Backtracking is 
especially costly for two reasons. First, it entails physical movement to make a transition 
from one state to another in the search space and such movement 1s vastly slower than 
computation. Second, it implies movement which does not add to the agent’s knowledge 
of the search space. In most classic search algorithms, no cost is associated with 
backtracking: none 1s needed. A pointer 1s merely redirected or a context 1s popped off a 
stack. In contrast, persistent search associates a cost with backtracking which enables it to 
minimize physical movement in a realistic way. 

Persistent search 1s the embodiment of a new methodology for treating search by a 
physical agent which trades additional computation for a reduction in physical movement. 
An interesting additional property of this algorithm is that through the manipulation of a 


single control variable, termed the persistence factor, the operation of the basic algorithm 


can be changed to span the continuum of behaviors between depth-first search and breadth- 


first search. 
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Il. PROBLEM STATEMENT 


A search problem may be characterized by a start state, a description of a set of goal 
States and a set of transition operators which transform one state into another. A state is a 
collection of information of sufficient content to uniquely differentiate one state from 
another. If there exists a transition operator which transforms a state A into a state B then 
state B is called the immediate successor of state A. The set of all states reachable from the 
Start state through the application of transition operators 1s known as the search space. 

A search problem may be represented by a graph and in special cases by a tree rooted 
at the start state as shown in Figure 2.1. Search has the effect of overlaying a tree of 
explored nodes onto the search space even when the search space may not naturally have a 
tree-like structure. The depth of the search is the length of the longest path to any state in 
this tree. A search space is naturally represented by a tree if there exists no transitions 
which create circuits. Circuits are transitions which allow a State to be visited more than 
once along a path in the graph. Circuits create connections between separate branches of 
the graph. 

Since persistent search operates on a search space represented by a graph, it can 
therefore be considered as a variation of the graph traversal problem. A graph consists of a 
finite set of nodes V joined by a set of undirected arcs E. The nodes represent states in the 


search space while the arcs represent legal transitions between states. 





Figure 2.1 Maze with Tree Representation 


The terms node, state, and location all represent the same concept of situation or 
condition, but each implies a different context. Node is used when discussing search in the 
context of graph traversal. Use of the term state implies a general or abstract discussion of 
search. When referring to states as locations, the context is that of the chosen problem 
domain, search in a rectilinear maze. 

Traversing the graph is a single physical agent which attempts to arrive at a single 
distinguished node called the goal state. The agent, which has no prior knowledge of the 
graph, attempts to minimize the amount of physical movement expended searching for the 
goal. Although the agent has no knowledge of any paths to the goal, it does have a method 
for judging its nearness to the goal. This nearness can be measured in a number of ways 
including absolute distance, number of arcs to the goal, amount of difference between the 
description of the agent’s current state and the goal state, etc. 

The identity of the physical agent performing the search is not specified in the 


problem. It could be an autonomous vehicle or robot attempting to find its way across 


unfamiliar terrain, able only to sense its immediate surroundings. The agent could also be a 
packet of information traversing a packet switching network from the node of the packet’s 
sender to the node of its addressee. The routing logic at each packet switching node knows 
only which nodes are attached to it, not the entre set up of the network. 

In a more restrictive case, the agent could be a read/wnite head on a tape drive. Here 
the environment (tape) moves instead of the agent (read/wnte head), but the effect is the 
same. In optimum search on a tape (Hu, 1987, pp. 573-590), m records are stored 
alphabetically on a tape. A binary search of the tape minimizes the number of comparisons 
but not the amount of movement of the tape. A linear search of the tape minimizes the 
number of movements but not the number of comparisons. A tape-optimal search 
minimizes the total cost of comparisons and movements. Optimum search on a tape is 
considered a restricted case of the general problem because the search space can be 
naturally represented by a tree. 

For the purpose of using a real world example, the case of a robot traversing a 
random maze is chosen and will be used throughout this thesis. Among all of the real 
world examples, it is the most directly applicable and simplest to grasp while still 


encompassing the full dynamics of the general problem. 





Figure 2.2 Maze with Rectilinear Graph Representation 


The unknown terrain over which the robot will travel is represented by a rectilinear 
graph or grid-graph as shown in Figure 2.2. Nodes are arranged in a rectangular fashion 
with arcs connecting nodes immediately above and below and to the nght and left (north, 
south, east and west respectively). Each node then has four possible immediate successors 
which are distinguished from one another by their x and y coordinates. 

Locations within the maze are either passable or impassable. Impassable locations in 
the maze are represented by disconnected nodes in the graph, making them unreachable 
from any direction. 

As stated above, the robot begins with no knowledge of the graph. It may learn 
about the graph only as it moves from node to node via the edges connecting them. The 
robot’s ability to sense its surroundings is limited to determining whether the immediate 
successors of the current state are passable or impassable. In effect, the robot can judge 
whether it can move to the north, south, east or west. Since the terrain is a grid-graph, the 


robot is only able to move and survey in the four cardinal directions. 


Additionally, the robot knows its position relative to the goal. Several different 
means could be used to accomplish this. If the robot initially knows the goal’s position 
relative to its own, it can maintain this knowledge through dead reckoning as it moves 
about the maze from its initial starting point. Using this information the robot can 
determine its rectilinear distance from the goal as well as the distance from the goal to any 
immediate successor state. The following formula computes rectilinear distance from the 
node’s x and y coordinates: 

Dee. Nsollivoekee | (2.1) 

The r subscript is used to indicate the robot’s coordinates while the g subscript 
indicates the goal’s. 

Using a different method, either an active or passive guidance system could also be 
used to direct the robot to the goal (e.g., either a form of radar or a beaconing system). 
While only lines of bearing are required to choose which immediate successor is closer to 
the goal, an exact location for the goal is required to totally order the search space. If the 
goal is northeast of the current location, then the states to the north and the east are closer to 
the goal and have the same rectilinear distance to the goal. However, when comparing 
widely separated locations, a ranking for the locations based on their closeness to the goal 
cannot be determined without an exact location for the goal. If location P is north of the 
goal and location Q is south of the goal, there is no static way to tell which one is closer 
merely by their direction to the goal. By tangulating lines of bearing taken from different 


locations, an exact location for the goal can be determined. 


Il. SURVEY OF CLASSIC SEARCH METHODS 


Different search methods can be classified based on the way transition operators are 
applied to control the traversal of the search space. There are two major categories of 


search methods: depth-first and breadth-first. 


A. DEPTH-FIRST SEARCH 

Depth-first search is the simpler of the two. Beginning at the start state, depth-first 
search makes a transition to an immediate successor state. It then performs the same 
operation again moving to a successor state of that state. This continues until a goal state is 
reached or a State which has no successors is reached. If the current state has no 
successors, depth-first search backtracks along its path and tries to reach new states by 
taking previously unchosen transitions in the order in which they are reached while 
backtracking. One can also view depth-first search in the following way. At each state 
reached, depth-first search places all immediate successor states on a stack, a last-in, first- 
out (LIFO) data structure. It then pops a state off the stack and makes it the current state. 
If a state which has no successors is the current state, no transitions are pushed onto the 
stack. A state previously pushed onto the stack is then popped off and made the current 
State. A stack 1s a data structure which automatically supports this type of backtracking. 

Depth-first search moves away from the start state very quickly but can pass by the 
goal, performing needless additional search. This becomes a very Serious problem, 


especially when the search space 1s very large. 


B. BREADTH-FIRST SEARCH 

While in the current state, breadth-first search chooses every possible transition. It 
applies them all in turn, adding the immediate successor states reached by each transition to 
an agenda of new states not yet explored. States on the agenda are also called frontier 
States. Frontier states are states which have been examined and perhaps rated by either a 
cost or evaluation function, but not yet explored. A state has been explored if its immediate 
successor states have been examined and added to the agenda. 

Breadth-first search adds all immediate successor states of the start state to the 
agenda. It then begins working its way from the beginning to the end of the agenda, 
adding the successors of the states it explores to the end of the agenda. The agenda is 
equivalent to a queue data structure, first-in, first-out (FIFO). The search continues until 
either the goal is found or until the agenda 1s empty, signifying the exhaustion of the search 
space. Typically, breadth-first search progresses very slowly but is guaranteed to 
eventually reach the goal if the goal is located within the search space. If the number of 


successors of each state is very large, breadth-first bogs down very quickly. 


C. EVALUATION AND COST FUNCTIONS 

Each of the above methods may be guided by an evaluation function, a cost function 
or both. An evaluation function is a way of associating a number with a state which is a 
measure of the state’s goodness in regard to it leading to the goal state. Traditionally, the 
closer the value of the state’s evaluation function is to zero, the higher the state’s rank. An 
evaluation function always looks forward from the current state to the goal state and 


therefore its value 1s often referred to as a state’s estimated future cost. 
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A cost function applies a price to a state transition or to an entire path. The value of 
the cost function tells how expensive a particular transition or path is. Again, as with 
evaluation functions, smaller 1s better — the lower the cost of a transition, the higher its 
ranking. A cost function measures from either the start state or current state to a successor 
State, associating the cost of the whole path with the successor state. 

A convenient way to tell the difference between a cost and evaluation function 1s that a 
cost function looks at the states where the search has been while an evaluation function 
looks ahead and assesses where the search is going (Rowe, 1988, pg. 201). Some search 
techniques combine the cost and evaluation function in guiding the search. In such cases it 
is best to choose functions which are measured in the same units, since it often does not 
make sense to mix unrelated quantities (e.g., combining gallons of fuel expended with 
minutes of exposure to enemy fire). The sum of the values of a state’s cost and evaluation 
functions 1s referred to as the state’s combined cost. 

To further clanfy the use of cost and evaluation functions, their role in solving two 
problems will be examined: a bin packing and a maze problem. In the case of searching 
through a maze, every intersection in the maze is considered to be a state. The paths 
leading to and from the intersection are transitions leading to other states. The goal and 
Start states are randomly chosen intersections. 

A good evaluation function for this problem is a state’s straight line distance to the 
goal state. If the agent’s movement through the maze is limited to movement left, night, 
forward and back, then the state’s rectilinear distance to the goal location should be the 
evaluation function. Both of the above functions have the desirable property that their 
return values are continuous and smooth. The values do not jump around wildly as the 


search progresses from state to state. 


1] 


In a search of a maze with variable cost regions, where the cost of moving from one 
location to another is not constant, a cost function can be used to constrain the search. This 
is often done when searching for the least cost path. Only the move which would result in 
the least cost path from the start state to the new State is ever taken. 

In the case of a bin packing problem, where a set of objects are to be stored in the 
fewest number of bins, the number, total weight or volume of items left to store could 
serve as the evaluation function. The cost function for this problem can be represented by 
the number of bins used. A transition has a cost of one if it causes a new bin to be used, 
zero otherwise. The total number of bins used would be the cost of the path composed of 


the set of transitions chosen. 


D. HILL-CLIMBING SEARCH 

Variations of depth-first and breadth-first search are possible through the use of cost 
and evaluation functions. Using an evaluation function with depth-first search, an 
immediate successor state which is closest to the goal will always be explored first. This is 
called hill-climbing. While this is very useful in guiding the search, it still very often leads 
to trouble. Because each transition decision is based solely on the current state, hill- 
climbing can very quickly go wrong due to local minimums. These are paths that start out 
looking promising but do not lead to the goal. They either end in a dead end or eventually 


turn and lead away from the goal. 


E. BEST-FIRST SEARCH 
A variation of a breadth-first search using an evaluation function which avoids the 


above problems is called best-first search. Best-first search adds the successors of the 


Current State to its agenda which ts ordered by the value of each state’s evaluation function. 
The state with the lowest value for its evaluation function is at the front of the agenda and is 
made the next current state. Its successors are then added to the agenda in order. This kind 
of agenda can be easily represented by the use of a priority queue or a min-heap. 

Using best-first search, exploration can often expand towards the goal just as quickly 
as with hill-climbing search. Best-first search also has the added benefit of always moving 
to the state with the lowest evaluation function result, thus keeping the agent from 
searching at a depth beyond the depth of the goal, missing it just because it was initially 


misled by a local minimum. 


F. BRANCH-AND-BOUND 

Branch-and-bound (B&B) search methods use a cost function to constrain the search 
and may be either of a depth-first or breadth-first variety. Breadth-first B&B adds states to 
the agenda according to their cost function result. The lower the cost function, the higher 
on the agenda the state is placed. The state with the lowest cost function 1s explored next. 
Breadth-first B&B guarantees the first path to the goal found is the optimal or least cost 
path (Kumar, 1987, pp. 1000-1004). Of all search strategies, breadth-first B&B hops 
around the most since it is controlled by a cost function stemming from the start state. In 
an homogeneous cost search space, breadth-first B&B radiates symmetrically from the start 
State. 

Depth-first B&B always moves to the immediate successor state which has the least 
cost. Depth-first B&B follows the path of least resistance and so is like a stream of water 
running down hill. Only when it is dammed up does it back up and start flowing down 


another branch. 
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G. A* SEARCH 

A* (pronounced “A star’) is a very powerful search method which combines a cost 
and evaluation function to produce a flexible and capable search method. A* adds states to 
its ordered agenda according to the combined cost of each state’s evaluation and cost 
functions. It then explores the state at the front of the agenda. A*’s cost function measures 
from the start state to the state to be explored. Just like breadth-first B&B, A* guarantees 
the first path to the goal found is the optimal path under the extra condition that the 
evaluation function result for the current state is always less than or equal to the actual cost 
of the path from that state to the goal (Hart, 1968, pp. 100-107). A* 1s most often used in 


path planning problems. 


H. PATH PLANNING VS. PATH FINDING 

Path finding algorithms differ from path planning ones in that path planning 
algorithms require complete knowledge of the search space. They are used when it is 
important to find and record a particular path to the goal (usually the optimum). Path 
planning is a batch process that takes place prior to traversal of the search space by a 
physical agent. If the terrain can be represented as a graph without negative costs 
associated with the edges, then a variation of Dijkstra’s algorithm (breadth-first branch & 
bound) can be used to very efficiently find the optimal path from the start state to the goal 
state. More complex search strategies, such as A*, are used when it is necessary to reduce 
the branching factor of the states and hence reduce the search space. 

Path finding on the other hand 1s an interactive process that takes place as the graph is 


being traversed. No prior knowledge of the graph is assumed although the parts of the 
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graph which have been explored may be remembered. Unlike path planning, an optimum 
path seldom results from this kind of search. Any path found is considered a success. 
Path finding is only useful in those cases where incomplete information about the search 
space is available or full processing of the information is too costly. The use of path 


finding in the latter case is often called lazy evaluation. 


I. SUMMARY 

Each of the above algorithms may be the best search method for a particular set of 
circumstances, but each has significant weaknesses when dealing with the search problem 
of a physical agent traversing an unknown maze. In the next chapter, the persistent search 
algorithm will be described in detail, focusing on how it differs from the above methods 


and why it is particularly well suited to solve the selected search problem. 


ks 


IV. ALGORITHM DESCRIPTION AND IMPLEMENTATION 


The algorithm for persistent search will be described in two ways. The first 
description will be very general, suitable for application to any kind of search space. A 
very detailed description of the algorithm will then follow which is specific to the chosen 


problem domain of a physical search agent in a rectilinear maze. 


A. GENERAL ALGORITHM 
The algorithm for persistent search is presented in terms of a general search space 
with a cost and evaluation function. The algorithm 1s as follows: 


Step 0: Add the start state to the list of frontier states and make it the current 


State. 
Step 1: If the current state 1s the goal state, quit. 
Step 2: If the current state is not the goal state, remove it from the list of 


frontier states. 

Step 3: Examine all immediate successor states which have not yet been 
frontier states and add them to the list of frontier states. 

Step 4: Examine the list of frontier states. If the list is empty, quit; the 
search has failed. If the list is not empty, traverse to the best frontier 
State on the list; make it the current state and then go to Step 1. 

The best frontier state as described above in Step 4 is defined as the state, vy, which 


minimizes the equation: 


S(v) = g(r) * pf + h(y) (4.1) 


where g(v) is the cost of traversing to the state » from the current state; h(¥) is a lower 
bound estimate for the estimated future cost, the cost of traversing from the state v to the 
goal; and pf is the persistence factor, a coefficient for discounting the cost of backtracking. 

While the above algorithm is very close to the algorithm for A* search, one should 
note the subtle but important differences. g(v) is computed from the current state to the 
frontier state, rather than from the start state. This has the effect of totally negating the 
impact of past movements on future decisions. This is desirable since for a physical agent, 
once a move has been made there 1s no taking it back (without exerting a like amount of 
effort). All that matters in the search is where the agent is now and where it is going, not 
where it has been. 

A second difference shows in the use of the persistence factor as a cost coefficient for 
g(v). The persistence factor varies between 0.0 and 1.0 and serves to discount the cost of 
backtracking versus estimated future cost, k(). By varying the persistence factor, the 
behavior of persistent can be dramatically altered. When the persistence factor is 0.0, the 
cost of backtracking from one state to another becomes zero, negating it. Hence the 
formula for rating frontier states reduces to: 

f(y) =hov) (4.2) 
which is equivalent to that used for best-first search. Each frontier node is ranked only 
according to its esumated future cost. The physical agent will move about the search space 
without regard for the amount of movement required, traversing to which ever state is 
closest to goal. 

When the persistence factor is 1.0, the behavior of persistent search is equivalent to 
that of hill-climbing. Since the traversal cost from one state to another is fully counted, 


J(v) for a immediate successor of the current state will always be less than that of any other 
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frontier state. This can most easily be seen when the cost for moving to an immediate 
successor is the same for all states and A(v) is transitive. If g(v) 1s one for an immediate 
successor then the f(v) of the successor equals at most h(v) + 1. This will always be less 
than the combined cost of any other state since even if the A(v) of another state is lower, 
the traversal cost to that state will more than offset it. If another frontier state’s estimated 
future cost is h (v) and this is less than the successor state’s h(v), then they must be at 
least |h(v) - A (y)| away from each other. Figure 4.1 demonstrates this very clearly. 
State P’s estimated future cost (or distance from the goal) is four. The estimated future 
cost of state Q is six. Because the current state is only one away from state Q, its total cost 


will always be lower than P’s. This is true for all immediate successor states. 
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Figure 4.1 Maze with Frontier State P vs. Frontier State Q 


Since an immediate successor state will always rank higher than any other frontier 


node when the persistence factor is 1.0, persistent search will never backtrack until it must. 


It only backtracks when a state has no legal successors. Again, it can easily be seen that 
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this equivalent to hill-climbing and depth-first search in general. When backtracking, the 
frontier node closest to the current state will be chosen. This happens for the same reasons 
as above, because the cost of traversal to a frontier state will always overcome any 


difference in estimated future cost among States. 


B. SEARCH OVER A RECTILINEAR MAZE 

The algorithm for persistent search which deals with the chosen problem domain of a 
rectilinear maze executes in two stages, with the second stage’s execution depending on the 
results of the first stage. Several other changes in the algorithm have also been made for 
the sake of efficiency. Appendix A lists the source code for this specific implementation 
which will be explained in further detail below. The algorithm for persistent search in the 
context of an unknown maze 1s as follows: 


Step 0: Add the start state to the list of frontier states and make it the current 


State. 
Step 1: If the current state is the goal state, quit. 
Step 2: If the current state is not the goal state, remove it from the list of 


frontier states. 

Step 3: Examine all immediate successor states which have not yet been 
frontier states and add them to the list of frontier states. 

Step 4: If any of the immediate successor states have a lower estimated 
future cost than the current state, move to that state, make it the 
current state and go to Step 1. 

Step 5: If none of the immediate successor states has a lower estimated 


future cost than the current state, examine the list of frontier states. 


We, 


If the list is empty, quit; the search has failed. If the list is not 
empty, traverse to the best frontier state on the list; make it the 


current state and then goto Step 1. 


The best state is again defined as the state, vy, which minimizes the equation: 

f(y) = g(v) * pf + h(y) (4a) 

The above algorithm accurately reflects a robot traversing a rectilinear maze trying to 
reach a goal location. Step 3 implements the first half of the persistent search algorithm, a 
hill-climbing search. The robot 1s able to evaluate immediate successor locations with 
respect to their distance from the goal. A successor state is made the current state if its 
rectilinear distance to the goal is less than the current state’s. A simple north, east, south, 
west preference serves as a heuristic to break ties between successors of equal estimated 
future cost. This heuristic only results in multiple equivalent solutions when more than one 
path to the goal exists, such as when the maze 1s not a tree. 

Step 3 greatly reduces the computation required by persistent search since the agenda 
does not need to be examined when a successor state which is closer to the goal exists. 
The reasoning for this is exactly the same as that stated above for why persistent search 
with a persistence factor of one acts like hill-climbing search. As long as the search is 
moving towards the goal no state on the list of frontier nodes has a lower combined cost 
than the successor state picked. The function search() in Appendix A implements this 
portion of the algorithm. 

When no terrain map is available and a physical agent is performing the search, 
depth-first search variants such as hill-climbing and depth-first branch-and-bound are the 


only reasonable alternatives to persistent search. Breadth-first algorithms such as best-first 
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and breadth-first branch-and-bound jump around the search space excessively and perform 
too much unforced backtracking to be considered practical for a physical agent. 

Best-first search does perform well, doing very little backtracking, if there are very 
few local minimums in the maze. Best-first search immediately backtracks if there is a state 
on the agenda with a lower estimated future cost than any of the successors of the current 
state. This happens when local minimums occur within the maze. As stated above, best- 
first search is equivalent to persistent search with a persistence factor of zero. 

When there exists no successor to the current state which has a lower estimated future 
cost than the current state, the list of frontier states must be examined. This occurs in the 
function getbestnode() of the persistent search implementation. A min-heap maintains 
the list of frontier states with the state which has the lowest estimated future cost on top. 
Two-way links between the elements of the min-heap and the mapped portion of the maze 
are maintained to allow random access to the states on the min-heap and access to the 
state's description. 

A breadth-first search of the known maze scans for the frontier state with the lowest 
combined cost each time the list of frontier states must be examined. This search is called a 
backtracking search since it determines which state the agent will move to next and the 
agent may have to backtrack through previously traversed states to reach the frontier state. 
The depth of the backtracking search represents the result of the cost function, g(v), from 
equation (4.1) and is the traversal or shortest path cost to that state. The value of g(¥) is 
multiplied by the persistence factor to attain a modified traversal cost. 

The estimated future cost of every frontier state reached by the backtracking search is 
summed with its modified traversal cost to give a combined cost for the state. During the 


course of the search, the state found with the lowest combined cost so far is saved. This 


combined cost is then compared against a lower bound for the combined cost of the frontier 
state on top of the min-heap. Recall that the state on top of the min-heap is the fronter state 
with the lowest estimated future cost. The current depth is used as a lower bound for the 
traversal cost of this minimum frontier state. As the depth increases so does the lower 
bound of the traversal cost. 

The backtracking search for the best frontier state ends when the combined cost of a 
frontier state matches or exceeds the lower bound combined cost of the state with the 
lowest estimated future cost. This check 1s made whenever the lowest combined cost state 
found changes or the depth changes. The backtracking search 1s terminated at the earliest 
possible point while still ensuring that the state with the lowest combined cost 1s the state to 
be explored next. 

The state with the lowest combined cost represents the state most likely to lead to the 
goal without incurring overly expensive backtracking costs. The lower the persistence 
factor is for a search, the farther an agent will be allowed to travel to reach a state with a 
low estimated future cost. The persistence factor greatly influences the amount of 
backtracking which takes place during a search. 

The path followed to every state during the backtracking search of the known maze is 
temporarily saved in each state’s description so that once the best next state is found, the 


agent can traverse the indicated path to the state. 
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V. ANALYSIS OF ALGORITHM AND SEARCH COMPLEXITY 


Formal complexity analysis of an algorithm determines the amount of resources (i.e., 
memory, time, etc.) needed by the algorithm as a function of the size of the problem 
instance (Brassard, 1988, pg. 5). The search complexity of a search problem is equal to 
the number of states evaluated. The algorithmic complexity of persistent search can then be 
stated as a function of the search complexity and the cost of making a transition during the 
search. The size of the search space places an upper bound on the search complexity, since 
the search space is the set of all reachable states. For an arbitrarily large search space, this 


result is not very satisfying since its limit grows without restriction. 


A. SEARCH COMPLEXITY 

A tighter bound for search complexity can be achieved by reasoning about the 
branching factor and the depth of a search problem (Rowe, 1988, pp. 207-208). The 
number of immediate successors of a state 1s called the branching factor of the state and 
usually includes only those successor states not already explored. If the branching factor 
for all states is not the same, then the average branching factor over all states is taken to be 
the branching factor for the search. The branching factor can also often be computed as the 
ratio of the number of states at depth k + 1 away from the start state to the number of 
States at depth k. 

The lower bound for the depth of a search is the number of transitions along the 
shortest path in the search space from the start state to the goal space. The search 
complexity can then be stated as: 


CBee i) (B= 1) (S21) 


where B is the average branching factor and K is this lower bound for the depth of the 
search (Rowe, 1988, pg. 208). For large branching factors, the equation (5.1) can be 
approximated by: 

Bk (S22) 
By convention, the term n shall often be substituted for equation (5.1), when referring to 
the size of a problem instance. 

For the general case of graph traversal, the branching factor has an upper limit of 
V - 1, where V is the number of nodes in a completely connected graph. This then makes 
the depth of the search one, since every node is an immediate successor of every other 
node. The branching factor has a lower limit of one since the graph can be a chain of V 
nodes. In this instance, the depth has an upper limit of V - 1 since the start state and goal 
State could be on opposite ends of the linear chain. As can be seen for the general graph 


Case, the size of the search space is bound by the depth and branching factor of the search. 





Figure 5.1 (a) Maze Without Cycles (b) Maze With Cycles 
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For the case of a rectilinear maze, an exact limit for the average branching factor can 
be computed in terms of the depth, K. A rectilinear maze with and without cycles is shown 
in Figures 5.1(a) and (b). Again, the main difference between the two types of mazes is in 
how they may be most naturally represented. As it happens, they also have different 
branching factors. 

In the case of a rectilinear maze with cycles, the branching factor of the search is 
again severely constrained by the topology of the maze. At each deeper level of the search, 
the number of nodes on that level exceeds that of the previous level by four. This is 
illustrated in Figure 5.3. To calculate the upper bound on the number of nodes at any depth 


in the search of a rectilinear maze, merely multiply the depth by four. 





Figure 5.3 Maze With Cycles Showing Search Order 


The size of a rectilinear search space with circuits is therefore bounded by a function 


of the depth of the search. For a rectilinear maze with circuits this is: 
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n=2*k2+2*k+1 ? (5.3) 
where k is the current depth of the search and n is the number of states in the search tree. 

For a search of sufficient depth over a maze without cycles, the limit of the average 
branching factor approaches one even faster than above. A single starting node in a 
complete rectilinear maze is allowed to expand freely and only those nodes which would 
result in circuits are disconnected. Figure 5.2 displays this scenario, showing expansion 
level by level. Expansion is constricted to the expansion of only four states at regular 
intervals, just as at a depth of three in the figure. The branching factor is severely 


constrained by the topology of the maze. 





Figure 5.2 Maze Without Cycles Showing Search Order 


For a rectilinear maze without circuits, the upper bound on the size of its search space is 
conjectured to be: 


n=k242%*k+2 (5.4) 
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B. ALGORITHM COMPLEXITY 

Now that a tighter bound has been placed on the search complexity, O(k), a 
reasonable worst-case complexity for the algorithm may be shown. By examining each 
Step in the general algorithm for persistent search as stated in Chapter IV, a computational 
cost in terms of mn may calculated. Step 0 is only done once and takes constant time. Steps 
1 through 4 may be done up to m times, once for each state in the search space. No state is 
ever examined more than once. The complexity of any one of these steps must therefore be 
multiplied by n. 

In Step 1, the current state 1s checked to see if it is the goal state. The amount of 
computation needed for this is proportional to the amount of information needed to 
distinguish one node for another. In the strictest sense, this increases as the log, of the 
number of nodes, n. This is most easily shown if each node is uniquely identified by an 
integer. The more nodes, the greater the number of bits needed to represent the integer 
Signifying a particular node. So the complexity of Step 1 is O(log) when including bit 
complexity. Bit complexity is often ignored when determining algorithm complexity thus 
making the ttme complexity of Step 1 constant, or O(1). 

In Step 2, the current state 1s removed from the list of frontier states. Locating the 
Current state in the agenda list can be done in constant time if a link to the state’s position in 
the list is kept in the state’s representation. In the implementation of persistent search 
discussed above, the frontier list is kept in a min-heap so as to allow easy access to the 
smallest element and efficient updating of the list. Removing an element from the min-heap 
requires O(log,7) time. 

All immediate successors of the current state which have never been frontier states are 


examined and added to the list of frontier states in Step 3. The complexity of finding 
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immediate successors of the current state is equivalent to that of the transition operators 
multiplied by the number of successor states. The operators are assumed to take constant 
time and since any state in a rectilinear graph has at most four immediate successors, the 
complexity is merely a constant multiplied a constant. Telling whether a state has been a 
frontier state also takes constant time since that information 1s part of its state description. 
Adding the states to the frontier list takes O(log.n) time for a min-heap. 

Step 4 examines the list of frontier states and traverses to the best one. This takes 
O(7) time since every state in the search space up to that point in the search may have to be 
examined to determine the best state. Traversing to the best state on the list also make take 


up to O(7) time in the worst-case. 





Goal 


Figure 5.4 Worst-case Maze for Persistent Search 


Figure 5.4 shows an example of a worst-case situation. The maze is linear with the 
goal unreachable. Persistent search will constantly have to explore the entire search space 
to determine the best state, no matter what the persistence factor. Several methods for 
combatting this are discussed in the next section of this chapter. 

By combining the tme complexities for the above steps, the exact time complexity for 
persistent search is given by the following equation: 


T(n) =cl +n * (c2 +3 * logon +c4 * logon + c5 * n) (5.5) 
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cl through cS are constant factors. cl represents the time complexity of Step O and the 
terms inside the parentheses represent the tme complexity for Steps 1 through 4. 

For sufficiently large m, only the highest order term is significant; the rest can be 
dropped. Ignoring lower order terms, Equation (5.5) simplifies to: 

T(n)=c *n? (5.6) 
where c is aconstant. Substituting Equation (5.3) for m in Equation (5.6) 

T(n)=c*(2*k2+2*k+1)2 (5:7) 
the computational complexity of the algorithm is shown in terms of k. If the depth of the 
search is limited to k, then ignoring lower order terms the limit is: 

Mik) =c * k* (5.8) 

While the time complexity of persistent search is of O(k*), or O(m?), its space 
complexity is of O(77). Only enough memory to store the state information and the frontier 


list is needed and both of these items are of O(7). 


C. COMPLEXITY SHORTCUTS 

Several methods for reducing the complexity of persistent search are possible under 
Certain conditions. With a persistence factor of 1.0, there exists no chance of backtracking 
before a state without successors 1s reached. There is no reason then for evaluating any 
state beyond the first frontier state found when backtracking from the current state. Setting 
the persistence factor to m ensures that the first frontier state reached will be have a lower 
combined cost at the time it is reached than the frontier state on the top of the min-heap. 
This results in the backtracking search terminating immediately and with the agent 
traversing to the first frontier state found. By limiting the backtracking search in this way, 


the amount of computation performed by persistent search is reduced to within a constant 
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factor of the amount of computation performed by hill-climbing search. Since n is 
normally not known prior to the search, a very large constant can be used for the 
persistence factor. 

By maintaining the min-heap in the implementaion, persistent search is able to cut off 
the search for the best frontier state at the earliest opportunity, after it is sure it has found 
the best state. Although worst-case scenarios can still be created which require O(n?) time, 
the average case complexity is much lower. Empirical testing of the algorithm has shown 


very favorable results in comparison to hill-climbing search. 


30 


VI. EMPIRICAL TESTING AND RESULTS 


In order to better judge the performance of the persistent search algorithm, a random 
maze generator and a hill-climbing algorithm were both implemented. See Appendix C to 
examine the actual code. These implementations were not only useful in testing persistent 
search but also in improving it. The testing also revealed several weaknesses in the testing 


methodology which was subsequently revised. 


A. MAZE GENERATION 

The random maze generator operates in two modes, creating mazes with or without 
cycles. The mazes without cycles can be naturally represented as trees and those with 
cycles can be represented as graphs. This mode implementation was necessary because of 
the nature of persistent search’s backtracking. When backtracking, persistent search 
alwavs follows the shortest path to the next frontier state. This gave persistent search an 
extra advantage over hill-climbing search which can only trace back along its original path 
to its next frontier state. In non-tree mazes, this results 1n a large amount of back and forth 
movement by the hill-climbing algorithm as it winds its way out of large open areas. This 
inefficient behavior can be seen clearly in Figure 6.1. Persistent search cuts across its own 
path following short circuits in the terrain. If the maze 1s a tree, there are no circuits, which 


offsets persistent search’s advantage and allows it to be more accurately evaluated. 
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Figure 6.1 Hill-climbing Search in a Maze With Cycles 


The function makemaze() implements the maze generation algorithm. Using a 
depth-first algorithm to follow a random path through an empty maze, makemaze() 
creates obstacles at intervals along its path according to a maze density parameter. 
makemaze() begins by creating the bounds for the maze and then picks a random starting 
point within the maze. The algorithm maintains a trail of the locations 1n the maze it has 
explored. 

At each step along its path, it randomly determines whether it must turn from its 
current direction. If so, it places an obstacle in the direction it was going and continues on 
in a random new direction. The higher the maze density, the more likely it is that the path 
will turn and an obstacle will be created. If the maze generator becomes blocked by its own 
trail and obstacles, it backs along its trail until it comes to an open location to which it then 
moves. 

If makemaze() is restricted to creating mazes which are trees, it must also check 


before it takes a step to see if the next location it is going to explore will create a cycle in the 


maze. If so, it places an obstacle there instead and chooses a new direction. In a maze 


without circuits, there is only one path from any state to any other state in the maze. 


B. HILL-CLIMBING SEARCH EVALUATION 

For comparison with persistent search, a hill-climbing algorithm was implemented. It 
is very similar to the algorithm used to create the maze as they are both depth-first 
algorithms. An evaluation function determining which successor location was nearer the 
goal was added to the maze generating depth-first algorithm to create the function dfs(). 

dfs() uses a simple stack to keep its current path and a bitmap to mark where it has 
been. It places all successor states on the stack and then moves to the state on the top of the 
stack. dfs() uses the same heuristic that persistent search does. It chooses between 
successor States with equal estimated future costs by using a simple north, east, south, and 
west preference. Again, dfs() performs exactly like persistent search with a persistence 
factor of one, choosing to explore the same nodes in the same order. 

The results comparing hill-climbing to persistent search are very favorable for the 
new algorithm. With very few exceptions, a persistence factor for the search can be found 
which beats hill-climbing search and minimizes the amount of movement required by the 
agent to find it way to the goal. In all cases, persistent search can do at least as well as hill- 


climbing search. 
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Figure 6.2 — Graph of moves vs. persistence factor for a maze 
of size 16 X 16 and a maze density of 0.5 


Both the number of moves made by the agent and the amount of computation required 
were recorded for each test run. The graphs in Figures 6.2 through 6.5 show the number 


of moves and the amount of computation for two representative test runs and a range of 


persistence factors. 
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Figure 6.3 — Graph of computation vs. persistence factor for a 
maze of size 16 X 16 and a maze density of 0.5 


A persistence factor of m applies only to reducing the amount of computation. The 
persistence factor is set to a number larger than the number of states in the search space. 
This reduces backtracking search and makes the amount of computation done by persistent 


search equivalent (within a constant factor) to that done by hill-climbing search. 


oe) 
‘A 





Gee = Hill Climbing -~-O--~ Persistent Search 


# of Moves 





0.0 0.1 0.2 073 024° 025 "020m 0 7) Oo Cre eee 


Persistence Factor 


Figure 6.4 — Graph of moves vs. persistence factor for a maze 
of size 64 X 64 and a maze density of 0.5 


As can be seen from the graphs, both the number of moves and the amount of 
computation vary greatly with the persistence factor. There is no smooth curve. because 
persistent search depends on catching discontinuities in the graph. Persistent search excels 
when a local minimum is followed which quickly turns away from the goal. Hill-climbing 
must follow these local minimums to their end while persistent search can cut them short 
and move tO more promising paths. 

Over 27,000 test mazes were created and comparisons of persistent search and hill- 
climbing search performed. On randomly generated mazes which were trees, persistent 
search performed better, making fewer moves, than hill-climbing search over 40% of the 


mazes with some persistence factor and performed at least as well with some persistence 


factor in 100% of the cases. In mazes which were not trees, persistent search bettered hill- 


climbing in 87% of the test runs with some persistence factor. 
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Figure 6.5 — Graph of computation vs. persistence factor for 
a maze of size 64 X 64 and a maze density of 0.5 


Several factors influenced the results of these tests in the hill-climbing algonthm’s 
favor. First, the search space is bounded. Hill-climbing can stray from the path to the goal 
and wander forever while following a local minimum and never reach the goal unless the 
search space is bounded or an arbitrary limit for the depth of the search is set. Persistent 
search needs no such boundary as it uses its persistence factor to cut short a path but then 


possibly later continuing that path. Bounding the search space has the effect of setting an 


of 


arbitrary limit for the depth of a search without the possibility of cutting short the search too 
soon. 

A second advantage is that the random maze is generated with an algorithm very 
similar to dfs(). Both are depth-first searches in nature, but makemaze() uses a random 
heuristic to choose the next state while dfs() uses an evaluation function. This advantage 
was curtailed by using a new random starting location for the search than the one used by 
makemaze() to create the maze. 

As can be seen in the results for the number of computations performed by persistent 
search, higher time complexity algorithms soon outstrip constants and lower order 
algonthms no matter how large their coefficients. This implies there is a limit to the size of 
the search space that persistent search can traverse before the computation time for the 
search takes longer than the time needed to physically traverse the search space. The time 
needed to physically traverse the search space is proportional to the number of states. The 
time complexity of persistent search is proportional to the square of the number of states. 

In the broadest sense, persistent search applies to any search where physical 
constraints apply to the exploration of the search space. This applies to movement by a 
physical agent, be it a robot or a read/write head on a mass storage device, as well as to the 


transmission time of a network packet of information. 


Vil. FUTURE RESEARCH 


A number of possible areas of future research suggest themselves from the empirical 
testing and conclusions. The first and the closest to the heart of this research is the 
implementation of methods for changing the persistence factor in an adaptive manner 
during the course of a search. The second is the use of persistence search in non- 
homogeneous cost search spaces, consisting of non-unit cost transitions. The first area of 
research provides ways to improve the performance of the algorithm, the second expands 
the set of problems to which it can be applied. 

Although persistent search always performs as well as hill-climbing, it 1s very 
dependent on the choice of the nght persistence factor. Even so, search spaces are not 
completely consistent in that a single persistence factor operates best throughout the course 
of a search. When the search space is a tree, there exists only one path to the goal. The job 
of persistent search is to see that the agent does not stray too far from that path. There are 
multiple “fateful turns” along that path When the persistence factor is too high and a 
wrong turn is made, no correction of the error is possible before the agent is whisked 
away. When the persistence factor is too low, the agent 1s plagued by indecision, running 
back and forth over its path unable to move forward in a definitive way. 

Without global knowledge of the search space, no perfect method exists for adjusting 
the persistence factor during the course of a search, although several useful heuristics 
suggest themselves. The first heuristic for improving the performance of persistent search 
involves regulating the persistence factor in inverse proportion to the density of the maze. 
Empirical testing revealed a tendency for a search with a high persistence factor to do better 


on a less dense maze. In the corresponding opposite case, a search with a lower 


ao 


persistence factor does better in a more dense maze. This trend was very strong when 
testing on non-tree mazes, but was inconclusive when testing on tree mazes. One factor in 
this is that density is far less distinct when also preserving the tree property of the maze. 
The above results tend to bear out one’s natural intuinon. When the terrain is wide 
open and there are but a few sma!l obstacles, it pavs to just go directly around them rather 
than double back and try a different tack. The search is very unlikely to be led too far out 
of it wavy. When the terrain is dense and large obstacles are common, then dead ends and 
local minimums are common. It pays to do some backtracking in order to find a path to 


the goal. 
é : : ; onal | wr Cin ae 
Another heuristic fr adjusting the persistence factor wauid. 


< 


be vas it’with the 
distance from the goal state. When the current state is far from diieicoal. make the agent 
more persistent so that it will cover a larger area with less backtracking. When the agent is 
close to the goal, have it be less persistent so that it will cover the terrain surrounding the 
goal more thoroughly. The author calls this method the bird dog technique. When a bird 
dog is on the trail of a pheasant, let’s say, and the scent is faint (the pheasant is far away), 
the bird dog very quickly covers a large amount of terrain in an ambling manner. When the 
scent 1s strong. the dog’s movement and attention becomes very concentrated. The dog 
traces and retraces its path covering a very small area very thoroughly. Judging from 
hunting dogs observed in the past, this method is very effective. 

An area of research which would greatly expand the applicability of persistent search 
would be to implement it for a search problem where the costs of making a transition from 
State to state 1s variable. This research would dovetail well with current research within the 


Computer Science Department at the Naval Postgraduate School. It could easily be added 
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to a number of ongoing projects. The change to the algorithm itself is slight and only a 
single variable need be added to each state description. 

To handle variable cost transitions, add a variable to each state description to hold that 
state’s path length from the current state. Now when performing the search over the 
known terrain for the best next state, instead of merely keeping track of the depth of the 
search, update each state with its path length from the current state. Use the state’s path 
length instead of depth to calculate the best next state. As one can easily see, the changes 
required to handle this new expanded problem domain are almost trivial. 

Persistent search is totally new in its perspective on the problem of search and much 
more work will be required to fully ascertain its worth. Many new applications and deeper 


insights await to be discovered. 


APPENDIX A 


PERSISTENT SEARCH C CODE 
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* 


* 

* _ psearch ace A program which demonstrates and evaluates the persistent 

be) search algorithm as specified in the NPS Master's Thesis 

: titled: Persistent Search: A Bridge Between Depth-first and 
= Breadth-first Search For Physical”Agents, June Pees 

x 

ter It cCeneby. Michael M. Mayer, LT, USN 

x Dates 29 May 1989 

* Version: to 

* 

“Compiles: Written in C on a VAX 11/785. Versions alsowavailalateweer 
. the Apple Macintosh and Silicon Graphics IRIS4D/70GT 

* Options: The following compiler options are allowed via the -D option 
ys TREES Causes makemaze() to produce mazes which are trees rather 

i than more general graphs. 

ze PM Causes the display of the mazes generated by makemaze () 

* PP: Causes the algorithms to print their path as they search 

* 

#5 Compiling ; ce psearch.c (1 -PTREB IN (-DPM)) (DPB lao pseaccr 

* Usage: psearch <maze size> <maze density> <persistence factor> 


KKK KKK KKK KKK KERR KKK RRR KK RRR KKK KKK KKK KK KKK KK KKK KKK KKK KKK KKK KK KKK KKK KKK KK KK KK / 


J/teancilvgertiiless «7 
Finciuce <star1oene 


#define 
#tdefine 


#define 
#define 
#define 
#define 
#define 


Te 
#define 


/* 


#adefine 


/* 
tdefine 


Yee 


#define 


PARSE 0 
TAU x 
fe max frontier nodes = 2x + 2, where x = path length. Therefore 
hn = 2x + 2 + x, where n = # nodes */ 
MAXFRNTRNODES -(saze * ‘size eo 3% 2547) 
NUMLINKS 6 /*x* number of connected nodes (NESW) */ 
UNKNOW? 0 /* code for node never before seen */ 
ViCtier 1 /* code for node that has been traversed */ 
FRONTIER z /* code for node that is on the frontier - 
seen but not traversed */ 
recti-linear distance */ 


dist(a,b,c,d) (abs((a)e- e)\9 + abs, — (da) )) 
turm x,y “coordinate into array wae, 7 
nee} Cy) Aesess ft Zeaet na) 

get x coordinate from array index */ 


getx (x) ((x) % size) 
get v coordinate from array index */ 
gety (y) ((y) / size) 


typedef struct a node 


{ 


unsigned 


} node; 


unsigned char 


unsigned char 
Um@oawgnec int 


noce 


Emesga2ed int 


unsigned int 


unsigned int 


unsigned int 


double 


alge 

estfutcost, 1s 
/* 
/* 

parent, lig 


links[NUMLINKS], /* 


status, (Pe 
mhindex, Hee 
searchid; ie 


witTey a llve as 
erat. : {2 
*pstack; ae 
*myworld; fs 
*heap; as 
*agenda; et 
compares, /* 
MOVES, /? 


dfscompares, /* 


dfsmoves; Hoe 


Size, /* 
Start, /* 
goal; jae 
Pay ie 
deve scy, es 


estimated future cost */ 

result of the evaluation function */ 
node's rectilinear distance to the goal */ 
index of node used to get to this node 
during backtracking search*/ 

links to the North, East, South, West */ 
whether the node has not been seen before, 
visited, or on the frontier */ 

index of a frontier node on the minheap */ 
index of node started from during 

search for best frontier node 

gQGuarenteed to be unique since a node is 
never searched from twice */ 


a bitmap holding the representation 

of the terrain. In a robot, this bitmap 
supplies input to the robot's sensors */ 

a bitmap representing the nodes traversed 
by the makemaze function */ 

a stack holding the path being followed by 
the makemaze function */ 

the two dimensional array of nodes which 
holds the robot's representation of the 
terrain seen so far */ 

a minheap which holds the frontier nodes 
in order of their estimated future cost */ 
& Circular queue holding the nodes seen 
but not yet expanded in a breadth-first 
wnich attempts) Go find the best frontier 
node to go to next */ 


number of operations performed 

by persistent search */ 

number of moves by the agent traversing 
the maze from the start to the goal using 
persistent search */ 

number of operations performec 

by depeh-ti1estesearchne(hill-climbing) */ 
number of moves by the agent traversing 
the maze from the start to the goal using 
Gepth-first search (hill-climbing) */ 


size on a side of the maze, a square 

Size x saze large */ 

the index of the Start node in the maze 7”/ 
the index of the goal node in the maze */ 


persistance factor of the search */ 
density of the maze */ 


eS 
{> 


ilo eli (r-\ alo fern amrst aro (9) 
int. axrge- 
ehay "ara | 
{ 
unsigned int x, y?; /* loop variables */ 
double ator) /* ascii to floating point library fune@eeneee 


/* check number of arguments passed to psearch */ 
if (arge < 4) 
{ 
fprintf(stderr, “Error: §eece.ew arguments .\n.)-, 
exit); 


/* get parameters: 1) size of the maze 
2) density of the maze 
3) persistence factor of the search */ 
Size = atou(angy 1) ) ey oGee ce 
density = atot(argv|2)])- 
pi. = vatof (argvi3i): 


/* allocate dynamic memory for data structures */ 


world = (unsigned char *)calloc(size * size / (sizeof (char) *#gee 
sizeof (char)); 

trail = (unsigned char *)calloc(size * size / (sizeof(char) * 8), 
Sizeof(char)); 

pstack = (unsigned int *)calloc(size * size, sizeof(unsigned int)); 

myworld = (node *)calloc(size * size, sizeof (node) ); 

heap = (unsigned int *)calloc(MAXFRNTRNODES + 1, sizeof (int)); 


agenda = (unsigned int *)calloc(MAXFRNTRNODES + 1, sizeo£i(intjge 


/* create random maze */ 
makemaze (); 
i> OLINe Out Mezeu- 
Deine ma ze l) 
/* perform depth-first (hill-climbing) search on mazeus7 
als We. 
/* perform persistent search on maze */ 
init heap(); 
addheap (Start); 
Search(getx (Start), gery (stare. Gdecx(gcal) ,. cet, (cca .e, 


/* print results of search */ 
printf ("persistance factor:%.2f£\nmaze density:%.2f\n", pf, densauwe 
princf ("afs:24d psiytd moves <n ~artsmoves,, meves)- 
printf ("dfs:%4d ps:%d comparisons\n", dfscompares, compares) ; 


/* free dynamic memory */ 
free (heap); 
free (agenda) ; 
free (myworld) ; 
free (world); 
free (pstack) ; 
Ereettre 22); 


} /* main */ 
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int search(x, y, goalx, goaly) 


unsigned int x, y, /* coordinates of current node */ 
goalx, goaly; /* coordinates of goal node */ 
{ 
aint oe (= lank Garectionm £rom current node */ 
best; /* index of best next node */ 
#ifdef PP /* print out coordinates of current node */ 
merci ("PS visited: td, td\n", x, y); 
#tendif 


meet! atgoal (x, y,goalx, goaly))} /* see if the goal has been found */ 
{ 
/* keep statistics */ 
movestt; 
comparestt; 


/* update map and list of frontier nodes */ 
alterheap (myworld[indx(x, y)].mhindex); 
myworlelifindx (x, y))].status = VISITED; 
sectlinks(x, Vv, Goaly, Goaly): 


/* find out if there exists a successor node which: 
1) as reachable from the current node 
2) has not yet been visited and 
3) is closer to the goal than the current node 
i= 0; 
while( 1 < NUMLINKS && 
tmywor ladles (x, vy) Jenks Paes 6 
MvVorle ty worl alinax (a,— youl slanksilay i —scatuss = VISITED &€6& 
Closer t., Cee (NyWworlalinam(e,, Vi .tanks [1)); 
Getty (mywerlalines(x, vie links (4) ); goalx, goaly))) 


as 


/* if such a node exists go there and continue search */ 
ae a NUM LINKS) 
cearen(aer™ (mywor  a(anee (>, vy) |S lanks(2)), 
Gecyv (myvrorla (wady (say) lemks (2), goals, goaly) ; 


else 
/* if not, get the best node from the list of frontier nodes */ 
{ 
best = getbestnode(x, y); 
if (best >= 0) 
/* if get back a node index, move to that 
node and continue search */ 
{ 
Drinesteps( (unsigned int) best, indx (x, y)); 
search(getx(best), gety(best), goalx, goaly); 
} 
else 
/* if returns -1, list is empty and search fails */ 
Prine CcNOusSOluMedon, pOsslole: \n’ ) 
} 
eee eS 


mee?) Search */ 


int getbestnode(x, y) 


unsigned int x, y; /* coordinates of current node */ 
{ 
ihe +) (*oelink Girect 10omet/ 

Cay /**emerent link index */ 
minindex = -l, /* index of node with lowest combined cost */ 
depth = 0, /* depth of backtracking search */ 
numthislevel = 1, /* number of nodes at cuurent depth */ 
numnextlevel = 0, /* number of nodes one level deeper */ 
id = indx(x, y), /* unique search identifier */ 
head = 0, /* head of circular queue */ 
tail = 0; /* tail of circular queue! *, 


/* combined cost of node with lowest combined costa 


float mincost = (float)size * size * pf + size * size + 1, 
CuBreost. /* combined cost of node being evaluated */ 
agénda [tail++]i*= inds (x7 /* insert into Circular queue =7 
while (head != tail) /* while circular queue not empty */ 
{ 
comparestt+; /* keep statistics */ 
/* if through with all the nodes at the current depth */ 
if (!numthislevel) 


{ 


depen 7, /* increase depth */ 
numthislevel = numnextlevel; /* get # of nodes at new depth */ 
numnextlevel = 0; 


/* see if combined cost of best node found so far is better 
than the lower bound for the combined cost of node with 
the lowest estimated future cost */ 

if (mincost <= (float)myworld([findmin())].esttutcoses 
(float) depth * pe) 
break; /* if so then search is complete */ 


46 


if (myworld[agenda[head]].status == VISITED) /* not frontier node */ 
for(i = 0; i < NUMLINKS; itt) /* for each edge */ 
{ 


ci = myworld[agenda[head]].links[i]; /* set current index */ 


/* if that node has not already been examined 
during the backtracking search */ 
if (ci && myworld[ci].searchid != id) 
{ 
myworld[({ci].parent = agenda[head]; /* set parent */ 


myworld[ci].searchid = id; /* mark search */ 
agenda[tail] = ci; /* add to queue */ 
tail = ++tail * MAXFRNTRNODES; j= tun Corme. */ 
numnextlevelt++; /* add to next level */ 
} 
} 
else fx Sehas 16 (actrontier node */ 


/* get combined cost of frontier node being examined */ 

Currcost = (float)myworld[agenda [head]].estfutcost + 
(float) depth.~* pt; 

/* if better than current minimum combined cost node */ 
ie eUr Yr COSt <4 mincost) 
{ 

minindex = agenda [head]; /* get new mincost node */ 

MinGCOst = CUrrecos.- /* get new mincost */ 


/* check combined cost just like the time above*/ 
iE WMane@ser <— it oat myworlal|tinamin())]sesttutcos= + 
(ElOae) aepil 7 ape ) 
break; /* if so then search is complete */ 
} 
} 


numthislevel--; /* done checking another node */ 
head = ++thead © MAXFRNTRNODES; /* turn corner of queue */ 
|} /* while */ 
return (minindex) ; /* return ancgex of Lowest secombined cost node */ 
} /* getbestnode */ 


Memeo ser (sl, y:, «2, y2Z, goalx, goaly) 

Mroraned int xl, yi, /* coordinates of current node */ 
Kee ye: /* coordinates of successor node */ 
Goalx, goaly; /* coordinates of goal node */ 


/* if current node is closer to goal than successor node, return true */ 


EorwGoMGi1st (siya cdoels, GOdlyja> Gisti(x2, v2, Qoalx, goaly)); 
leeey* Closer */ 
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} 


setlinks (x, y, Goalx, goaly) 
unsigned int x, y, /* coordinates of current node */ 
Gealx, "Goaly; 


/* coordinates of goal node */ 


{ 


/* get frontier nodes, fill in their state description, 


and add 
them to the list of frontderenoces  */ 
if ('getbik(x, y = 1, world)) /* North */ 
{ 
myworld[indx(x, y)].1inksiGie—- ind. (> ye), 


2 (imvwor bala mest, 


y - Die status) 
{ 


/* if status UNKNOWN */ 

myworld[indx(x, y - 1)].estfutcost = 

dist.(x, y - l, coalx,ecoaly)] 
myworld[indx(x, y - 1)].status = FRONTIER; 
addheap(indx(x, y ~ 1)); 
} 

} 
Lf ('oetbikiG 4 .1,. y,- worla)) 


/* East */ 
{ 


myworld[indx (x, y) ]. links hig=s2ndx (2, 
if(imyworld[indx(x +) 17) vy) seacus) 
{ 


VD 4 
/* if status UNKNOWN */ 


myworldiindx(x + 1) y)Jj2esermecese = 
Gase(x + 1, y,.1eealx mgeay): 

myworla[inds (x + 1, “y)] sstecus-= BRON TIER, 
addheap(indx(x + 1, y)); 

} 
} 
Sf (loetbik(s) ye), wore f*> Souths, 
{ 
myworld[inds(%, y) 1]. links (2s eee 
if (!myworla[ind= (x.y +e) ie steeus) 


/* if status UNKNG@ wa 
{ 


myworld(indx(x, y+ il) ]-estruceost. — 
Gist (x, y +17. Goal cca, i. 
myworld(indx(s, y+) j2sceabuse— Ron te. 
adaneap (nds x, vem), 
} 
} 
LE ( hoeCt okt es Vy word ae 


/* West */ 
{ 


myworld[inds (27 \y))-Jonkstei— iandx(x - 1; 


Lf Inyworid (ind (..— 


y); 
y)].status) 
{ 


/* if status UNKNOWN */ 
myworld([indx(= — 71) /eest rucecse, — 
Gisi(* — esveecoalx, geai 
myworldf{indx(x - 1, y)].status = FRONTIER; 
addneap(indx (x == si ,00y))) - 
} 


} 


i? seplinkcs 7 / 
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init_heap() /*@imaewalaze heap by setting its size to zero */ 


{ 
} 


heap[0) = 0; 


Ves anit heap */ 


mime t Lnamin () /* return node with the lowest estimated future cost */ 


{ 
} 


return(heap[1]); 


addheap (new) 


unsigned int new; /* item to be added to heap is index into myworld */ 
{ 
heap[(0O]++; /* increment heap size */ 
heap [heap[0]}]]}] = new; / = puteindex Ante, last position */ 
myworld[new] .mhindex = heap[0]; /* set link into minheap */ 
percolate (heap[0)); /* let item bubble up minheap */ 


} 


/* addheap */ 


alterheap (rm) 
unsigned int rm; /* index of element in heap to be deleted */ 


{ 


me Oldval ; 


if (rm > heap[0]) Ee PER OR eX / 


{ 


else 


else 


} 


momanet (Stdern, “Tried removing element [td] with heap size [td] \n", 
rm, heap | 0] )> 


Get (1); 
if (rm == heap[0]) /* if removing last element in heap */ 
heap[0]--; /* just decrement heap size */ 
Bec ci; 
/* remove element and adjust heap */ 


Ooldval = myworld([heap[rm]].estfutcost; 


heap[(rm]) = heap[heap[0]]}; /* replace element to be removed 
with last element */ 

heap (0) -—-; /* just decrement heap size */ 

myworld[heap[rm]].mhindex = rm; (2 AGaiiste lank tO Minheap */ 


/* decide whether to bubble element up or down */ 
Brmywor ba (heap [rm] }] -esttuteose,~ cldval) 
percolate (rm) ; 
else 
settle (rm); 


/* alterheap 7*/ 
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percolate (start) /* bubble element up in heap */ 


unsigned int start; /* starting position within heap ee, 
| ping cgeo er /* heap index */ 
temp; /* temporary Swap variable */ 
for (1 = start; 1° '= 17° 47 —e) /* from start to every parent */ 
: comparestt; /* keep statistics */ 


} 


/* if cost of child is more than the parent then swap them */ 
if (myworld(heap[i])].estfutcost < myworld[heap[i / 2)]).estfutcost) 
{ 

temp = heap[i / 2); 

heap[(i / 2) = heap[iljJ; 

heap[i] = temp; 

temp = myworld[heap[i / 2])].mhindex; 

myworld(heap[i / 2)]).mhindex = myworld[heap[i]].mhindex; 

myworld[heap[i]].mhindex = temp; 
} 
else 

break; /* done bubbling up */ 

} 


/* percolate */ 


settle (stare} /* bubble element down in heap */ 
unsigned int start; /* starting position within heap */ 
{ 
inte, /* heap index */ 
temp, /* temporary swap variable */ 
Chara: /*® Andex-cof child */ 
1 = Starc; /* current index is start */ 
while (i <= heap[0j / 2) /* while current index is not a leaf index */ 
{ 
comparest+t+; /* keep statistics */ 
Chala 27 aaaeean, J geo child andex */ 


/* if second child exists and its estimated future CoOS=t ieee 
than the first child's, make it the current chijda 
2£ (child + 1 <= heap[0] && myworld([heap[child + 1]] -estiutgga a 
myworld[(heap[child]].estfutcost) 
echavlca.. 

/* if cost of child is less than the parent then swap them */ 
if (myworld[heap[i])].estfutcost > myworld[heap[child])].estfutcost) 
{ 

temp = heap[child]; 

heap(child) = heap[i]; 

heap[i] = temp; 

temp = myworld[(heap[child] ) .mhindex; 

myworld[(heap[(child])].mhindex = myworld[heap[i]].mhindex; 

myworld{heap[ijJ]).mhindex = temp; 


break; /* done bubbling downy: 7 
peer a /* curren: element 15 now the Che lavelemen.a 


iieeatgoal(x, y, goalx, goaly) 
G@nsigned int x, y, /* coordinates of current node */ 
gGoatx, goaly; /* coordinates of goal node */ 


== goalx && va Gealy); f= 


| 


return (x 
} /* atgoal 


Peemesteps (finish, start) 


Mmsioqned int finish, /* index of 


/* index of 


ifeoe goal node return true */ 


best next node */ 
current node <*/ 


Stare, 
{ 
Meeweurrnode = myworld[finish]) .parent, 
pid) = finish, 
fea ole = finer: 
while (currnode != start) /* reverse pointers along path */ 
{ 
fuga. — Curr node, 
currnode = myworld[currnode] .parent; 
Meworldiolo|{edrent = neal old; 
Bea Ol” = Sons ; 
} 
currnode ele; 
Meete (Currnode != finish) j Seri tGAnorsa: enc Girseth @/ 
{ 
moves, fF EKeeo Status Cs: 27 
tifdef PF /* print out traversed node 7/ 
wee he ViSaceG: tC, 2G\n' , CCEhRe(currnode);, cecy (currnode)); 
Fema: = 
Ger rnece = MmMywerld(currnode! - parent: fie icllov peer */ 
} 
M_epemeor in steps ”/ 


tn 
oe 


setblk(x, y, bitmap) 
unsigned int x, y; /* coordinates in bitmap */ 
unsigned char *bitmap; /* bitmap in which to set value */ 
/* sets the bit in the bitmap corresponding to the provided x,y coordinate */ 
{ 
unsigned int byte, /* byte where x,y coord is located */ 
op oe /* bit in byte where x,y is located */ 


byte = indx(x, y) / (sizeon(ehar a o)., 
bit = indx({x, y) @ (sizeot (char m7 6); 
bitmap[byte] |= 1 << (7 - bit); 

} /* setblk */ 


getblk{x, y; bitmap) 

unsigned int 74, 4. /* COordamates in bitmapee 

unsigned char *bitmap; /* bitmap from which to get value */ 

/* return the value of the bit in the bitmap corresponding to the x,y 
coordinate provided */ 


{ 


unsigned int byte, /* byte where x,y coord is located */ 
bate /* bit in byte where x,y is located */ 

byté.="indx(x, yy) / (sizeotiehar) se > se) 

bit =“indx(x,7y) -= (sizeof (ehar) e280); 


return((bitmap[{byte] >> (7 - bit)) & 1); 
) (Pe tgern lk *7 


APPENDIX B 


PERSISTENT SEARCH LISP CODE 


; Original implementation of persistent search in Lisp. 


5 Written by: Michael M. Mayer, LT, USN 


; Date: 1 September 1988 

; Version: 20 

; Sompi ler : Written in Allegro Common Lisp on the Apple Macintosh 
; Usage: (psearch '(sStartx starty) '(goalx goaly)) 


(require 'quickdraw) 

(defvar *persistence-factor* 0.5) 
(defvar *future-locs* nil) 

(defvar *agenda2* nil) 

(defvar *path2* nil) 

Woervar *“complete-trail2* nil) 

;column number Oeeieee ens: >) 7, 629 


(defvar *world2* '((1 
(1 
(i 
(1 
(1 
(1 
Ci 
(1 
(1 
(1 


eee ee eee See 
~ ™—es ‘we “6 
wo DATING OI KH WNFH © 


« “=e 


row number 


HOO Oo 0 - OS °O,O O' 
Sete tS OS Oo 
FPOrRrOrRFOrOOFrK 
rOrRrOAODOFOOFH 
rMPOrRPPRP PP PHP HP 
ie o> i coe Fae a A a FE os Je oo om 1 we 
PRRPOrFRRPOOOF 
BOO O10 O1eO Clo 
ee a ee 


(defun init-psearch2 () 
(setq *path2* nil) 
(setq *agenda2* nil) 
fsece *future-locs* nil) 
(setq *complete-trail2* nil) 
setc *dead2* nil)) 


(defun stats2 (thewindow) 
(ask thewindow (move-to 8 214)) 
femzinc “The path length is: " thewindow) 
meram. (length *pathZ2*) thewindow) 
(ask thewindow (move-to 8 228)) 


(princ "The # of moves made is: " thewindow) 
(eran! (length *complete-trail2”) thewindow) 
ey 


(defun moves-away2 (ptl pt2Z) 
(+ (abs (- (car ptl) (car pt2))) (abs (- (cadr ptl) (cadr pez) ae 


(defun update-lists (newpath) 
(let ((pathback (set-difference *path2* newpath) ) 
(pathforw (reverse (set-difference newpath *path2*)))) 
(setq *complete-trail2* 
(append (append (reverse pathforw) 
(remove (car *path2*) pathback) ) 
*complete-trail2*) ) 
(draw-circles pswindow2 pathback *white-pattern®*) 
(draw-circles pswindow2 (reverse pathforw) *light-gray-pattern®*) )) 


(defun pathlength (x y) 
(- (+ (length x) (length y)) (* 2 (length (intersection x y :test '‘equal))))) 


(defun compare-agenda-items (iteml item2) 
(cond ((<= (+ (get iteml 'distance) 
(* (pathlength (get iteml 'path) *path2*) 
*persistence-factor®) ) 
(+ (get item2 'distance) 
(* (pathlength (get itemZ2 'path) *path2Z*) 
*persistence-factor*) )) 
item1) 
(tai temzZ je) 


(defun best-on-agenda () 
(do* ((agenda *agenda2* (cdr agenda) ) 
(best (car *agenda2*) (compare-agenda-items (car agenda) best))) 
((mull (cdr agenda)) best))) 


(defun movep2 (dir loc) 
(cond ((equaly dae. "nore 


(and (<= (nth (car loc) (nth (1=—= “~cadr loc) )) *worlaZ ja 
(not (member (list (car loc) (l- (cadr loc))) *complete-trail2* 
:stest 'equal)) 
(not (member (list (car loc) (l= (cadr loc))) *future=teeee 


stest '‘equal)))) 
((equal dir ‘east) 
(and (<= (nth (1+ (car loc)) (nth (cadre Loc) “world a 
(not(member (list (1+ (car loc)) (cadr loc)) *complete=te ama 
:stest *equal)) 
(not (member (list (1+ (car loc)) (cadr loc)) *future-Begee 
‘test ‘equaaaa. 
((equal dir 'west) 
(and (<= (nth (l= (car loc)) (nth (cade loc) e*werla a 
(not (member (list (1- (car loc)) (cadr loc)) *complete-traae 
:test ‘equal)) 
(not (member (list (l- (car loc)) (cadr loc)) *future-legee 
‘test ‘equaljgas 
((equal dir 'south) 


(and (<= (nth (car loc) (nth (14 Weade cee woot) ao 
(not (member (list (car loc) (1+ (cadr loc))) *complete-traww 
:test ‘equal)) 
(not (member (last (car loc) (1+ (cadr loc))) *future=Veee. 


stest ‘equal jams 


(defun add-agenda 
(setq *agenda2* 


item) 


(item) 
(cons item *agenda2*) ) 


(defun any-poss-dirs (start goal) 
(let ((no-bktrk nil) (temp nil)) 


(when (movep2 


(setf 


(setf 
(setf 
(setq 
(setq 


(when (movep2 


(setf 


(sett 
(setf 
(setq 
(setq 


(when (movep2 


(setf 


(setf 
(set ft 


(get 


"south stare?) 
(add-agenda (gensym)) ‘'distance) 


(moves-away2 (setq temp (list (car start) (1+ (cadr start)))) 


(get 
(get 


(car *agenda2*) ‘path) *path2*) 
(car *agenda2*) ‘loc) temp) 


*future-locs* (cons temp *future-locs*) ) 
no~bktrk t)) 


(Ger 


"west Start} 
(add-agenda (gensym)) ‘'distance) 


(moves-away2 (setq temp (list (1- (car start)) (cadr start))) 


(get 
(get 


(car *agenda2*) ‘path) *path2*) 
(car *agenda2*) ‘loc) temp) 


FEUCULre-lOcs-= scons tems. ~future-locs~))) 
MoO=DkKt rk €)i) 


(get 


"east start) 
(add-agenda (gensym)) 'distance) 


(moOVeS-aWay 7 s(SerG “eemp (last (i+ (car Start) ) (cadr Start) )) 


(get 
(get 


(car *agenda2*) '‘path) *path2*) 
(car *agenda2*) ‘loc) temp) 


(eeeq *future-locs* (cons temp *future-locs*”)) 
Setq no-bktrk t)) 


(when (movep2 


(sett 


(setf 
(sett 


(cet 


“NOr Gh, Start) 
(add-agenda (gensym)) '‘'distance) 


({moves-awayZ (setq temp (list (car start) (l1- (cadr start)))) 


(get 
(get 


(cary ~agendeZ)o path). ~path2Z* ) 
(car *agenda2*) ‘loc) temp) 


meee tutlure-locs* (cons temp *future-locs*) ) 
Moetaq NO-~bDkKErK t)) 
no-bktrk) ) 


(defun psearch 


(Stave goal) 


(seta *complete-trail2* (cons start *complete-trail2*) ) 


(seta *path2* 


(COnSwotalt *patnz™)) 


(draw-circle2 pswindow2 start *light-gray-pattern”) 
feona ((equal start goal) t) 


Cc 


(let 


((best nil) (best-loc nil) (best-path nil)) 


(cond ((or (any-poss-dirs start goal) (consp *agenda2*) ) 


(setc *agenda2* 

(remove (setq best (best-on-agenda)) *agenda2*) ) 
(setq best-path (get best ‘'path)) 
(setq best-loc (get best ‘'loc)) 
(SepGm-ruture-locs~-(remove best-loc *future-locs*) ) 
(update-lists best-path) 
(Seta *~path2Z* best —path) 
(psearch best-loc goal)) 


(Ce) ) 


goal) ) 


goal) ) 


goal) ) 


goal) ) 


;Graphics Support 


(defun showworld2 (thewindow) 
(ask thewindow (erase-rect 0 0 512 342)) 
(ask thewindow (move-to 175 228)) 
(prinl *persistence-factor* thewindow) 
(do ({y 0 {f+ ¥)) (world *worle2zs (cdr worla) 
( (nu lisiworlda)) 
(do (2 0 (1+ x)) (row (cae worle) ee icar iow) 
((null row) ) 
(if (equal 1 (car row)) 
(ask thewindow (paint-rect (* x 20) 
(4% y-520) 
(+(* x 20) 260) 
(+ (* y 20) 200m) ))) 


(defun draw-circles (thewindow ptlist pattern) 
(cone “C(null earist) ) 
(= 
(draw-circles thewindow™ (cdr ptilise) pattern) 
(draw-circle2 thewindow (car ptlist) pattern)))) 


(defun dGraw-circle2 (thewindow pt pattern) 


r2oG 7 () 
NO-Shire-Ke\: 
(coma ((shatt-xevy-c) (retwer) ) 
(c< (ge ne-shift-key)))) 
(ask thewindow (fill-oval pattern 
(eee eo =) 22 &) 
(Fy O(Gecls D-) we) 
(4 A g(Ccenree) AZO) 
(Gg (29 (cacr ee) 2 Q)ezC))) 
(A€SS Ghew2neow (indme-ove@i(# (car ci) at) 
(*.(Cace pc) wee 
(1°. (ces cc-) 2a) 2 
(= ( (ceca <2) Sa) Bu) 
; ae S 
(S8LS OCSswinscews (Crecs “yy eaeece 
swimi@ew-title "Persiscede Search 
wEneex-rype -code 
swincow-pesitaon #E (@5 ca) 
swindew-sive, #@ (200 $32) 
sWamGow-gone ‘("Meweliakx" 26))) 


a A) 
as 


;Menus 


(setq psmenul (oneof *menu* :menu-title 


(ask psmenul (add-menu-items 


SPS Actions") ) 


(ask psmenul 


(setq psmenu2 


(ask psmenu2 


(ask psmenu2 


(oneof *menu-item* 
smenu-item-title 
smenu-item-action 
*menu-item* 
smenu-item-title 
:menu-item-action 
*menu-item* 
smenu-item-title 
:smenu-item-action 


"Tnitialize" 

*(init-psearch2) ) 
(oneof 
"Show World" 

'(showworld2 pswindow2) ) 
(oneof 
Botactistics. 

'(stats2 pswindow2) ) 


(oneof *menu-item* 
:menu-item-title "Run (1 1) (8 8)" 
smenu-item-action ' (eval-enqueue 
"(psearche ae) "(8 8) ))) 
(oneof *menu-item* 
smenu-item-title "Run (6 1) (8 8)" 
smenu-item-action ' (eval-enqueue 
"{psearene. (6-1). °'48 -6)).)) 
(oneof *menu-item* 
smenu-item-title "Run (1 4) (8 4)" 
:menu-item-action ' (eval-enqueue 
"Wipsearea “(1 4)> ©6745) )))) 
(menu-install) ) 
(oneof *menu* :menu-title "Persistence" ) ) 
(add-menu-items 
(oneof *menu-item* 
smenu-item-title "0.0" 
smenu-item-action '(setq *persistence-factor* 0.0)) 
(oneof *menu-item* 
enue Teem=t1t le. O72" 
wmemma=item—-action '(Setq *persastence-factor* 0.2)) 
(oneof *menu-item’ 
smenucritem-title "0.3" 
smenu-item-action ‘(seta *persistence-factor* 0.2)) 
(oneof *menu-item* 
smenus-item-title "0.41" 
smenu-item-action '(setq *persistence-factor* 0.41)) 
(oneof *menu-item* 
smenu-item-title "0.5" 
smenu-item-action '(setaq *persistence-factor* 0.5)) 
(onecf *menu-item* 
smenu-item-title "0.66" 
smenu-item-action '(setq *persistence-factor* 0.66) ) 
(oneof *menu-item’ 
smenu-item-title "0.8" 
smenu-item-action '(setq *persistence-factor* 0.8)) 
(oneot *menu-item?* 
smenu-item-title "1.0" 
smenu-item-action '(setaq *persistence-factor* 1.0)))) 


(menu-instell)) 


‘Nn 
~~] 


APPENDIX C 


EMPIRICAL TESTING C CODE 


makema ze () /* generate a random maze */ 
{ 
unSsionea ant x, ¥, /* node coordinates. 77 
i /* loop index */ 
stepclear, /* movement is clear in current direction */ 
dir = 507 / "Current Gi rectionec 
lastdir = 0, /* Vast direction: 4, 
mazestart; /* starting point of maze creation */ 
aly ge ptop = 0; /* top cf the path stack */ 
float getrandom(); /* returns random number in range specified */ 
for (i = 0; i < size; i++) { /* set border of maze */ 
setblk(0- a. worla:: 
setblk(size - 1, i, world); 
setblk(1,; 0, worla)- 
setbik(i, size = DP wertld):; 


} 


/* picks a Starting peint for maze creation *~/ 


c 


mazestart = random() © ((size - 2) * (size - 2)) + size + 1; 


x = 
i ae 


GEtxX(Mazeseare):, 
gety(mazestart) ; 


SGtbDikizG Vy, erat. 
pstack[ptop] = mazestart; 


while(TRUE) { 


if (getrandom(1.0) < density) /* if rand less than density */ 
{ 
Gir = random() & 4; /*,eiange Garection <7 
switch (lastdir) /* block previous direction 
{ 
case 0: 


if ('qetblktx, yVo= ayeet ret) 
setblk (x, y = 17 iwerld: 
break; 
case 1: 
Lf ('oet bli + 1, yt ean) ) 
setblk(x + 1; Vv, world); 
break; 
case 2: 
if (!oetbikts, y 4 ltear)) 
setblk(x, yy + dyworla), 
break; 
Case 3: 
if('getbiki= = 17> y7,.e2a. 2) 
setblk(s = 12 Va werlas 
break; 
} “/* “switch (lastann) <7 
ie aa 3) 


Stepclear = FALSE; 


switch (dir) Pwaesecceit NOGe ume current, Girection is Clear */ 
{ 
case 0: 
PEt !oetbikia, y —- 1, trail) ee "cetblk(x, y = 1, world) 
#ifdef TREE 
&& treetest (x, y - 1) /* make maze a tree */ 
#endif 


stepclear = TRUE; 
Via 7 
} 
break; 
case ll: 
St uigetolkis + 1, y, trail) @e Soetblk(x + 1, y, world) 
#ifdef TREE 
&& treetest(x + 1, y) /* make maze a tree */ 
#tendif 


stepclear = TRUE; 
tet, 
} 
break, 
case 2: 
Peremets li 0y tel). trail). 2a, *oetblkix, yor 1, world) 
foeeet TREE 
&& treetest(x, y + 1) /* make maze a tree */ 
#endif 


Stepclear = TRUE; 


Va: 
} 
break; 
case 3: 
Prcigetole(2 = 1 wv. tratl)- 66 boecolk(= — ly vy, world) 
tifdef TREE 
&& treetest(x - 1, y) /* make maze a tree */ 
fendif 
) 
{ 
Stvepclear = TRUE; 
——s 
} 
break; 


ee tow ech (cir) */ 


if ('stepclear) frei t Current peat iencr. clear =*/ 
{ 
Hit. count. = 0, /* number of clear moves */ 
ehoice, /* which clear move chceser *7/ 
aicsl4) ; je arvtay of upto four clear moves */ 


while (!count) /* find all clear moves */ 
{ 
if(!'getblk(x, y = 1, trail) && !getblk(x, y = i) eweue 
#ifdef TREE 
&& treetest(x, y - 1) /* make maze a tree */ 
#endif 


dirs [count+iime0 : 
if(!getblk(x + 1, y, trail) && !getblk(x + 1, y, wees 
#ifdef TREE 
&& treetest(x + 1, y) /* make maze a tree */ 
#endif 


dirs[countt++]) = 1; 
if (!'qetblk(x, y + 1, trail) && !cetbik(x, y + 1) eieese 
#ifdef TREE 
&& treetest(x, y + 1) /* make maze a tree */ 
#endif 


divs |Gount++i)e— 2, 
if('getblk(x =- 1, y, trail) && !getblk(x - 1, y, were 
#ifdef TREE 


&& treetest(x - 1, y) /* make maze a tree */ 
#endif 
) 
dirs ([count++) = is. 
nse (iereablones, /* if no clear moves */ 
{ 
Deco /* pop path node off Stach 
if (ptop == -1) /* if stack empty, we're done!*/ 
{ 
Ssetstartandgoal(); /* get random start and goal */ 
1GSNs WOES 


x = getx(pstack([ptop]); 
= gety(pstack([ptop]); 


< 
| 


else /* pick one of, the clear moves */ 
{ 

Choice = random() = coume- 

Gir = dirs (choice); 

Swit CmaGa f) 


{ 


case 0: y-~-; break; 
Case 127+; break, 
case 2: ytt; break; 
Gase (82 x-=; 8 break, 
) Ye Sewiecn 4/ 
ee Sa a) 
} /* while */ 
) 0/7 eee 
pstack|?t+tpuep) — street me. 7/* pucenode on path stacks 
setblk (x70 yee /* aGateostrail bitmap 77 
laStid2 r= fee 


} J PU oe et 
| /* mekemaze */ 


60 


#ifdef TREE 


treetest (x, y) /* see if adding node to maze would cause a cycle */ 
Pmaetagned int x, y; /* coordinates of node to be tested */ 
{ 

int connect = 0; /* number of clear adjacent nodes in maze */ 


} 


merqetblk(x, y - 1, trail) ) 
connect++t; 

morgetbik(x + 1, y, trail)) 
connect++; 

meget blk(x, y + 1, trail)) 
connectt++t+; 

meqgetbik(x = 1, y, trail)) 
connectt+t+; 

if(connect > 1) 

{ 
Ssceple (x, vy, World); 
return FALSE; 

} 

else 
Eeturn TRUE; 


Peet reetest */ 


#tendit 


setstartandgoal() /* finds an open space to place the start and goal nodes 


{ 


} 


do 
{ 
Start = random() %# ((size - 2) * (size - 2)) + size + 1; 

meeosetle('cetblk(getx (Start), gety (Start), trail)); 
do 
{ 

goal = random() &@ ((size - 2) * (size - 2)) + size + 1; 
} while('getblk(getx(goal), gety(goal), trail)); 


/* setgoal */ 


float getrandom(range) 


float range; j= vate ~eturenee 1s in) 0 = range */ 
/* returns random floating point value in the range 0 - range */ 
{ 

Been ( (float) random() / (fiocat) OxXJPFFFFEF * range) ; 


} 


/* getrandom */ 


6] 


ay 


#ifdef PM 


Printomaze.) 


{ 


unsigned int i, 3}; /* loop variables */ 


for(i; = 0; i < size; i+4) 092 erm. mazew, 
{ 
for (5 = 07-5 <9s12e se 
if (getblk(j, i, world)) 
printf(" *"); 
else 
Prainct.¢ se 


Print! Cone. 
for(i = 0; i < size; i++) /* print maze and trail */ 


for(} = 0; 3 < size; j++) /* shows blocked open space */ 
{ 
if (getblk(j, a, world) 6& getblk (jee rat!])) 
fprintf(stderr, “trail/world mismatch: td, +d\n") eee 
if (getbik (4, 1,) world.) 
Prine l (ts. ve 
else af(getblkia, a, tram.) 
jopent puenane ye (6) 5 
else 
Princt (ar je 
} 
Brant feGavii 
} 


) Ope in timazer 27 


#else 


print_maze() 


{ 


bikes *  peintemazes 


ats () 


{ 


/* depth-first search (hill-climbing) */ 
unsigned char ~Jjistraxl; 
unsigned int *stack; 
unsigned int ear /* coordinates of current node */ 
gt, Oy? /* coordinates of goal node */ 
count = 0, /* number of successor nodes */ 
choice, /* successor node chosen */ 
aars{4); /* array of successor nodes */ 
int top = 0; /* top of stack pointer for stack */ 
/* get coordinates */ 
me Getx (Start) ; 
y = gety (Start); 


gx = getx(goal); 
eyes cevy (goal); 


/* allocate dynamic memory for the stack and dfs path trail */ 
stack = (unsigned int *)calloc(size * size, sizeof (unsigned int)); 
dfstrail = (unsigned char *)calloc(size * size / (sizeof(char) * 8), 

sizeof (char) ); 


/* make start node current node and mark the trail */ 
Seeolk(x, y, Gistrail): 
Stack (top) = Start; 


while (stack[top]) != goal) /* while we are not at the goal */ 
{ 
Soune = 07 
while(count == 0) /* while we have no successors */ 
{ 
#ifdef PP [eo apeinc petiieOL OtSeSearen ms), 


Sumer (ORS ey i oited ecco wn!” xXpay: 


#endif 


/* find legal successors */ 
eget, Vo =e OfSt red) )hoG6. Geri k(4,. vy — 1, world) ) 


Gars [(ceunt-—+ ie —s1nds(s,- yo=F 1)? 
Pe oer oe (etal we OrStrail)j 66 saqetolkm(s + 1, y,- world) ) 
Gr rcs ecunt ++) y-einax te. + 17 5; 
if(!getblk(x, y + 1, dfstrail) 6& !getblk(x, y + 1, world)) 
aiesieounes. | — 1ndx(x,ey + bys 
Paeegetothise= 1, Vredrstrain) 6&6 "qetblk(x = 1, y,; world) ) 
Sours hooune++). = sme eel, yi? 
if (count == 0) /* if no successors */ 
{ 
top--; i= BoC ers backs 7 
if (top == -1) /* if stack is empty */ 
{ 
Peee(Stack); /* free dynamic memory */ 


free (dfstrail); 
Sone Meo eC eSOLUCI ON possible! \n"); 
return: Pesca rch tarvleda.- recurn */ 


Bin 
(2) 


x = getx(stack [top] ); 
y = gety(stack([top])); 
} 
else 
{ 
/* piekvamea wecrion *~/ 
choice = closese(dirs, count; ox, gy)? 
x = getx(choice) ; 
y = gety(choice); 
ef A eee 7 
/* keep statistics */ 
dfsmovestt; 
dfscomparestt+; 
} /* while */ 
Stack[++top] = indx(x, y); /* push Stack +7 
setblk(x, y, dfstrail); /* mark trail */ 
} /* while */ 
#ifdef PP 
prantfi("DES visited: -td),.t0 wm. we 
#endif 
free (stack) ; /* free dynamic memory */ 


} 


free (diStrai!), 


/* dfs */ 


int. closest (divs, coun. G.,no.) 


are the x and y coordinates of the goal */ 


unsigned int dirs[], /* array of node indexes */ 

count, /* number of indexes */ 

G2, mows /* Coordinates of the goal = 7 
/ closest returns the index of the node which is the closest to the goal. 
* It chooses from the up to four indexes contained in dirs. count gives 
- the number of indexes contained in dirs. The indexes contained in dirs 
. are the clear nodes surrounding the current node. gx and gy 
* 
{ 


} 


mite J/* Loop Varivable */ 
winner = dirs[0]; /* index of best node up till then */ 
fort =f) 74 = coune at.) 
if (dist (gqetx (dirs [i]), sGetviaics la) o=,) ove 
dist(getx(winner), gety(winner), gx, gy)) 
winner = dirs([i]J; 


return winner; 


Te Closest */ 
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APPENDIX D 


RESULTS OF SAMPLE TEST CASE 


Maze density: 0.50 
* *x * xk x xk * x xk xk & & > > Ce a> ae > Ca Gap Gam Ca .¢ 
= 3 tabla! * * Ree ere ask XO  On.X 
* * ce x & Me OarOn Oe. AOD 
* * xk & x zk k k x * x OF X27 O Or x xX OF XX 
ves -* aa KOO" xX X00 0 0 0 
— * - og ae - xm SM PORO O10 xX O KX OC 
* * : ws i a8 MO OC XN OF xX OX Xx 
tod * x - KOE, © (CEO Oko 
a * * - ie K Rake Kk OO xX O XO 
* * ‘ Tos Mes AOOrOG AK Orx 5 OO: © 
= - * = * * KV Oe ke Owe Oo O° RO 
* * vs eT te) hs ta © PO Oe @ ay © o>, OM Cal @ aes @) 
- * * = * * XO ORONO ae Baie ae, 
— x * a Keone OO me Xx 3 O UO 
* x x Aon OC O-A- Oo 
<r nk: * *x * <oeek kK UK K a Coe <-> Gap Gam Cem Cae Gi Ga Gua 4 
Persistance factor: 0.90 

ps:23 moves peei25 comparisons 
wEsited: 6, 7 fo VS bees 77 7 PS visited: 
visited: 7, 9 PS. visited: 8, 3 PS visited: 
mersacedq: 9, & PS visited: 9, 9 PS visited: 
wesgucred: 10, 10 ES Visrtec: oy ole PS visited: 
wasited: 8, 11 Poe ViSlted: oS, i2 PS visited: 
wesated: 9, 13 Poovismeed: lO pars PS visited: 
mei ced: 11, 12 PoaVisited-) 115...) PS visited: 
msstcted: 12, 10 PS visited: 12, $3 PS visited: 


~OOKOKMOKOM 


~xMOM-MKMOMRMKMOOKRMOMROMM 
~OO0D0OKOOKMOMOMOOK 
~OmMKXOODOOKROOKXOKXKXOM 
—OmxMOKRMKMOOMOODOOIOIOOKX 
~ MMM MM MM MM OM OM OM OM MM 


—~OdO0K 


dfs: 163 moves dfs: 163 comparisons 


DFS vVisited- 6. DFS#visited..), 7 DFS visited: 
DFS.visateds) 7-2 DFS visited: 8, 9 DFS visited: 
DFS visited: 9, 8 DFS visited: 9, 7 DFS visited: 


DFS visited: 10, 6 DFS visited: 11, 6 DFS visited: 
DFS Visited.) 13 amc DES) Vism@eegeal 3.025 DFS visited: 
DES: visited: (15.05 DFS visited. 13,2 DES visited: 
DFS visited: 14, 1 DFS vasated: 13,. 1 DFS visited: 
DFS visited: 11, 1 DFS visited: 1172 DFS visited: 


DFS. visited: 9,..2 DFS visived: €; 2 DFS visited: 
DFS visited: 7, 1 DES Visited: ¢, 1 DES visited: 
DFS visited: 9, 2 DFS visited: 10, 2 DFS visited: 
DFS visited: 9hi, a! DES visited: 12, 1 DFS visited: 
DFS Vvisveed:" sac DFS vVisaeed: 13, 3 DFS visited: 
DFS visited: 13, 3 DFS visited: 13, 4 DFS visited: 
DFS visited: 11, 4 DFS visited: 10, 4 DFS visited: 
DFS visited: 9, 5 DFS visited: 9, 4 DFS visited: 
DFS visited: 7 4 DFS vismeed: 7,. 5 DFS visited: 
DFS visited: 75-35 DFS visited: 7, 4 DFS visited: 
DFS visited: 5, 4 DES visited: 5; 5 DFS visited: 
DFS visited: 4, 6 DFS visited: 4, 7 DFS visited: 
DFS visuted ss DFs visited: 4,798 DFS visited: 
DFS visited: —4, 10 DFS visited: 4, 11 DFS visited: 
DFS Visiered wo eee DES visatred: 3.613 DFS. visited: 
DFS visited: 4, 14 DFS visited: 4, 13 DES Visttec. 
DFS» Visited: 957.012 DFS Visteed.e2, iz DFS visited: 
DFS: Visited> aaa DFS visited: 1, 10 DFS visited: 
DFS visited: 2, 9 DFS visited: 1, 9 DES Visared-: 
DFS waisteed: see a DES Visi tec ec DES. Visited: 
DFS visited: 3,5 12 DES \visated: 3701. DFS viswied. 
DFS visited: 4, 10 DFS visited: 4, 9 DFS visited: 
DFS Visit eat. oc. o7 DFS visited: 3, 7 DFS visited: 
DES viSited: 4 se DFS visited: 4, 5 DFS visited: 
DFS Visitea: 2,505 DFS visitecdwec, 6 DFS Visited: 
DFS visited: 12377 DFS visited: 1, 6 DFS visited: 
DES Visited: 2-5 DFS visited, a4 DFS visited: 
DFS visited:: 1,3 DFS. visited, o2 DFS visited: 
DFS visited a3 one DFS visited: 3, 3 DFS visited: 
DFS Visited so. DFS visited: 3732 DES. visited. 
DFS visitea:4)ae DES -Visiveds 3, DFS visited: 
DFS visited: 22 DFS visited: 1, 2 DFS visited: 
DFS visited.) Moa DES vVisived-n2 4 DFS visited: 
DES visited: 157s DFS visited: 4, 5 DES visieed: 
DFS visited: 5, 4 DFS visited: 6, 4 DFS visited: 
DFS visited: 8, 4 DFS visited: 9, 4 DFS visited: 
DFS visited: 11, 4 DFS Visited s12,e4 DFS visited: 
DES@=vvsated:.-135 5 DFS visited: 14, 5 DFS visited: 
DES “vrsited: 13,06 DFS “visited:s12,) 6 DFS visited: 
DES. Visited:wil2, 6 DFS visited: 5 147 a6 DFS visited: 
DES. vistred:= 107 4 DFS visited:)3,>.7 DES visited: 
DFS visited: 9, 9 DES. wsated:: 9-5 10 DFS visited: 
DPS visa ted: 79, 10 DES wisitec:- 9,401 DFS visited: 
DFS visited: 8, 12 DES Visited: 6) 42 DFS visited: 
DFS. visi vec 10..0)— DFS «visiteac ss] i] 2 DFS visited: 
DFS visitecs ii, 12 DES visited 2,7. 11 DES wisited: 
DFS “VisSiwege a2). > DES visited: sls, 2 
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